CONVERGENCE TO TYPE I DISTRIBUTION OF THE EXTREMES 
OF SEQUENCES DEFINED BY RANDOM DIFFERENCE EQUATION 



PAWEL HITCZENKOt 



Abstract. We study the extremes of a sequence of random variables defined by the 
recurrence i?„ = M„i?„_i + q, n > 1, where Rq is arbitrary, (M„) are iid copies of a non- 
degenerate random variable M, < M < 1, and g > is a constant. We show that under 
mild and natural conditions on M the suitably normalized extremes of converge in 
distribution to a double exponential random variable. This partially complements a result 
of de Haan, Resnick, Rootzen, and de Vries who considered extremes of the sequence (i?„) 
under the assumption that P(M > 1) > 0. 



1. Introduction 

We consider a special case of the following random difference equation 
(1.1) R^ = Qn + MnRn-i, n>l 

where Rq is arbitrary and (Qnj^n); n>l, are i.i.d. copies of a two dimensional random 
vector (Q, M), and (Q„, M„) is independent of Rn-i- Later on we specialize our discussion 
to a non-degenerate M, and Q = q, a. positive constant. Much of the impetus for studying 
equations like (11. ip stems from numerous applications of such schemes in mathematics and 
other disciplines of science. We refer to |7l [20] for examples of fields in which equation 
(II. ip have been of interest. Further examples of more recent applications are mentioned in 
and for examples of statistical issues arising in studying solutions of (II. ip see [2]. 



A fundamental theoretical result that goes back to Kesten [1A\ asserts that if 

(1.2) Eln|M|<0 and Eln|Q|<oo 

then the sequence (Rn) converges in distribution to a random variable R, which necessarily 
satisfies distributional identity 

(1.3) R = MR + Q 

(see also [20] for a detailed discussion of the convergence properties of {Rn))- In the same 
paper Kesten showed that if -P(|M| > 1) > and (II. 2p holds then, under some mild 
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additional conditions on M and Q the limiting distribution is always heavy-tailed, that is, 
P(|-R| > t) ~ Ct~'^ for a suitably chosen k > 0. A different proof of this results was given 
by Goldie in [9J. By contrast, it was shown in [TO] that in the complementary case |M| < 1 
if IQI < Q' then the tail of R has no slower than exponential decay. 

Interestingly, much more work has been done in the heavy-tailed situation. This is 
perhaps at least partially caused by the fact that many of the processes appearing in appli- 
cations (for example GARCH processes in financial mathematics) are in fact heavy-tailed. 
Nonetheless, the case |M| < 1 and Q = q contains a number of interesting situations, 
including the class of Vervaat perpetuities, see e.g. [20]. Vervaat perpetuities correspond 
to M being a Beta(a, 1) random variable for some a > and Q = 1 in which case one gets 

(1.4) R=l + Mi + M1M2 + M1M2M3 + . . . 

(some authors prefer not to have a 1 at the beginning which corresponds to taking Q = 
M). Particular cases of Vervaat perpetuities include the Dickman distribution appearing 
in number theory (see [B]), in the analysis of the limiting distribution of Quickselect 
algorithm (see [16|), and in the limit theory of functionals of success epochs in iid sequences 
of random variables [191 Section 4.7]. Further connections are referenced in [13| and we refer 
there for more information. For recent work on perfect simulation of Vervaat perpetuities 
see ^ or 

In this note we will be interested in the extremal behavior of the sequence (Rn)- For 
any sequence of random variables (y„) we let {Y*) be the sequence of partial maxima, i.e. 
Y* = maxfc<„ Yfc, n> 1. With this notation, we will seek constants (a„) and (6„) such that 
for all X 

(1.5) P{an{Rn-bn) < X) >G{x), H ^ OO, 

where G is a non-degenerate distribution function. 

Under the assumptions that P(M > 1) > the extremes of the sequence (Rn) when 
both M and Q are non-negative were studied in [1] and were shown to converge (after 
suitable normalization) to Frechet (i.e. Type II) distribution with parameter n. Here, 
we consider the complementary case, namely of a light-tailed limiting distribution R. Of 
course, in this situation one expects convergence in (11.51) to a Gumbel (i.e. a double- 
exponential or Type I) distribution, provided that there is convergence at all. The latter 
need not be the case, however. Indeed, if Q = 1 and M has a two-point distribution 
P(M = 1) = p = 1 — P(M = 0) then as is seen from fll.4p R has a geometric distribution 
with parameter 1—p and thus no constants (a„), (6„) exist for which fll.5p holds for a non- 
degenerate distribution G (see [I5l Example 1.7.15]). Our main aim here is to show that 
under fairly general and natural conditions on M (and for a degenerate Q) (11.51) does hold 
for suitable constants (cin), (&«) and a double exponential distribution G{x) = exp(— e~^), 
—00 < X < 00. 
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2. Extremal behavior 

Following the authors of ^ we assume that both M and Q are non-negative. As we 
mentioned earlier we assume that Q = g > is a constant. So, we consider 

(2.6) Rn = MnRn-i + Q, n > 1, Ro - given, 

where M„ and Rn-i on the right-hand side are independent and where (M„) is a sequence 
of iid copies of a random variable M satisfying 

(2.7) < M < 1, M - non-degenerate. 

(The non-degeneracy assumption is to eliminate the possibility that R itself is degenerate.) 
Clearly, this is more than (11. 2p and thus implies the convergence in distribution of (-R^)- 
Furthermore, it has been known since \1QI that in that case the tail of the limiting variable 
R is no heavier than exponential. Note that if M is bounded away from 1 then R is actually 
a bounded random variable. To exclude this situation we assume that the right endpoint 
of M is 1, that is that 

(2.8) sup{x : P(M > x) > 0} = 1. 

Finally, we need to eliminate the possibility that i? is a geometric variable. To this end it 
is enough to assume that 

(2.9) P(M = 0) = 0, 

since this guarantees that the distribution of R is continuous (see e.g. [H Theorem 1.3]). 
We will prove the following theorem 

Theorem 1. Let (Rn) satisfy (12. 6p with M satisfying (12.71) - (12.91) . Then there exist se- 
quences (ttn) (bn) such that for every real x 

P(a„(i?* — hn) < x) — > exp(— e~^), as n ^ oo. 

3. PROOF OF Theorem [1] 

We first outline our proof which generally follows the approach of [3] (see also references 
therein for earlier developments). Writing out (12.61) explicitly we see that 

(3.10) Rn = q + qMn + gM„M„_i + ■ ■ ■ + gM„ . . . M2 + M„ . . . MiR^. 

Under our assumption (12. 7p (as a matter of fact, under the first part of (11.21) as well) the 
product 11^=1 goes to a.s. Consequently, the extremal behavior of {Rn) is the same 
regardless of the choice of the initial variable Rq. It is particularly convenient to choose 
i?o so that it satisfies (11.30 as then so does every A; > 1, making the sequence (i?„) 
stationary. Extremal behavior of stationary sequences is quite well understood (see e.g. 
[T5| Chapter 3]) and we will take advantage of that. To find the extremal behavior of {Rn) 
one has to do three things: 
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(i) analyse the extremal behavior of the associated independent sequence (i?„) consist- 
ing of iid random variables equidistributed with R, 

(ii) verify that the sequence satisfies the D{un) condition for sequences (m„) of 
the form n„ = 6„ + a;/a„, for any x and suitably chosen sequences (a„), (6„), and 

(iii) show that the sequence has the extremal index and find its value. 

Some of the difficulties with carrying out this program are caused by the fact that, 
contrary to the heavy - tailed situation, much less is known about the tail asymptotics 
in the case of light tails. A notable exception are Vervaat perpetuities (see jl9> Section ] 
for a discussion). General results on light-tail case are scarce (see [10], [121 E]) and less 
precise than Kesten's result in the heavy - tailed situation. As a consequence, less precise 
information about the norming constants (a„) (6„) will be available. Our substitute for 
Kesten's result will be two-sided bounds obtained recently in [II]. 

We will treat the three items above in separate subsections. 

3.1. Associated independent sequence. We appeal to the general theory of extremes 
as described in e.g. ^15, Chapter 1]. First, we know from [1] Theorem 1.3] that (12.91) and 
non-degeneracy assumption on M imply that R has continuous distribution function Fr. 
Therefore, the condition (1.7.3) of Theorem 1.7.13 of [IH] is satisfied and thus, for every 
X > there exist u„ = Un{x) such that 

(3.11) lim nP(i? > u„) = e"^. 
In fact, since R is continuous Un may be taken to be 

n 

where Fpt is the probability distribution function of R. The question now is whether u„'s 
may be chosen to be linear functions of x i.e. whether there exist constants a„ and 6„, 
n > 1 such that for x > we have 

(3.12) u„(x) = — + 6„, n>l. 

an 

To address that question we will utilize a recent result of [11] which states that there exist 
absolute constants q, i = 0, 1, 2, 3 such that for sufficiently large y > 

exp{coi/lnp£i } < P(-R > y) < exp{c22/lnp£a}, 

y y 

where, following [10], for < 5 < 1 we set 

(3.13) ps = F{l-5 < M <1) = 1- Fm{1-5) and po = \imps = ¥{M = 1). 

(5— >0 

Notice that by (12. 8p ps is strictly positive for 6 G (0, 1). Now, if 

F{R > Un) = — , 
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then 

expicoMn Inp^i^} < . 

Therefore, if Wn are chosen so that 

exp{coWn\np^} = , 

™" n 

then Un > Wn- By the same argument, if Vn are such that 

exp{c2f„lnp^} = , 

n 

then P(i? > Vn) < ^ so that m„, < f„. Hence for every a; > 

Wn{x) < Unix) < Vn{x) 

and thus for every n > 1 there would exist < q;„ < 1 such that 

Un = QnWn + (1 " an)Vn- 

If both (vn) and (w„) were hnear, say, 

for some «), {b'J, «), and (6;^) then (KT2^ would hold with 

On =(^ + ^-^7^) and 6„ = a„6^ + (1 - a„)6^. 

It therefore suffices to show the existence of linear norming for partial maxima of iid random 
variables (Wn) whose common distribution F\y satisfies 

1 - Fw (y) = exp{coy In p^^/y}, for y > yo, 

where Pci/y is given by (13.1 3p for some fixed random variable M satisfying (I2.7p - (I2.9I) . 

In accordance with [15, Theorem 1.5.1] to show that 

F{a'^{Wn-b'„)<x)^exp{-e--'), 

holds for every real x, the constants (a^) and b'^) must be constructed so that for every 
such X 

n{l - Fw{b'^ + x/a'J) ^ e'"", as n oo, 

i.e. that 



(3.14) nexp \ co{b'^ + 4) Inp , , > ^ e ^ 
Choose b'^ so that 

(3.15) Co6^1npci/fe; = - Inn. 



as ri — 7- oo. 



6 



PAWEL HITCZENKO 



Then the left-hand side of fl3.14p is 

exp S^cob'^ (inp^ - InPc./.,) + ^) + J InPe./., 

To choose (a^) first note that the difference of logarithms in the first summand is neg- 
ative. Hence, if for any n, a'^ < —K\\ipci/b'^ for some K < cq then the exponent is 
no more than —xcq/K < —x. Therefore, for any admissible choice of (a^) we must have 
liminfn a'^/ Inpd/fe^ < — cq which implies in particular that a'^b'^ — i- oo. Thus, the exponent 
in the above formula is asymptotic to 

cofe^lnp^i - Inp^jb'J + Co— lnpci/6^ 

We can further assume that for each n 1 — is a differentiability point of Fm and that 
the derivative, /m, is finite at 1 — ci/b'^. It then follows that the exponent is asymptotic to 



and thus we may choose 



(3-16) a; = Co ( — /m(1 - ^) - Inpci/fe^ ) 



3.2. D(un) condition. To check that D{un) condition holds for sequences of the form 
bn + x/an we proceed in the same fashion as [4| proof of Theorem 2.1]; the argument 
there was, in turn, based on [17, proof of Lemma 3.1]. Recall that, according to [T5l 
Lemma 3.2.1(ii)] it suffices to show that if 1 < «i < • ■ ■ < v < Ji < ■ ■ ■ < Js ^ are such 
that ji — ij. > Xn for A > then 

r s r r 

fc=l 171=1 k=l k=l 

as n — )• OO. Set / = {ii, . . . , and J = {ji, . . . ,js} and for any set A of positive integers 
let R\ = maxas A Ra- 
it follows from (12. 6p that for j > i we have 

Rj = q + qMj + --- + qMj . . . Mi+2 + Mj . . . Mi+^Ri 

where, for j > i we have set 



% ■=q + qMj + --- + qMj . . . Mi+2- 
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Hence, for any e„ > we obtain 

{R*j < Un} = f^{Sj,ir +Mj... Mi^ + iR,^ < Un} 

= {^{SJ,^^ <Un- e„} \ |J{M, . . . Mi^+iRi^. > tn}. 

Note that Rk and Sn,m are independent whenever, m > k so that {Ri : i G /} and 
{Sj^i^ : j G J} are independent, and hence we get 

P{R*j < Un, R*j < Un) > P{R*i < Un)PiSl,,. <un- 6^) - P{[j M, . . . M,,+ii?,„ > e^- 
Also, 

{S^i^ <Un- ej D {R*j <Un- 2eJ n f|{M,- . . . Mi,.+ii?,, < ej, 
which further leads to 

P{R} < Un, R*j < Un) > P{R*j < Un)P{R*j < Un - " 2P(|J . . . M^^ + ii?,, > e^- 

By essentially the same argument we also get 

P{R*j < Un, R*j < Un) < P{R} < Un)P{R*j < Un + 2tn) + 2P(|J M, . . . M^^ + iRi^ > e„). 

Combining these two estimates we obtain 

\PiR} < Un,R*j < Un) - P{R] < Un)P{R*j < | 

< max{P{R*j < Un) - P{R*j < n„ - 2e„), P{R*j < u„ + 2e„) - P{R*j < 
+2P(|jM,...M,,+ii?,^ >e„). 

Thus condition D{un) will be verified once we show that both terms in the sum on the 
right-hand side vanish as n — ?• oo. To handle the first term we use stationarity and the 
fact that js < n to find that the maximum above is bounded by 

Piun - 2e„ < Rj <Un + 2e„) < nP{un -2tn<R<Un + 2e„). 

Recall that satisfy (13. lip and (I3.12p . Thus, setting e„ = e/a„ with e > sufficiently 
small we get 

nPiun -2en<R<Un + 2e„) ^ e-^^-^'^ - e-^''+^'^ = 0(e). 
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Turning attention to the second term, using < 1 we see that 

P(|J . . . Mi,+ii?,,, > elan) < Yl ^^^^ ' ■ ■ ^v+i^v > e/^n) 
jeJ jeJ 

< nP{Mj^_,^...M^Ro> e/an). 

Intersect the event underneath this probabihty with {R > 26„} and its complement to see 
that this term is bounded by 

(3.17) nF{R > 2bn) + nF{Mj,.i^ ... Mi > e/(2a„6„)). 

Furthermore, since for any T > and sufficiently large n, 26„ = + > bn + T/ an, the 
ffist term fl3.17p is bounded by 

nr{R > 2bn) < nF{R > 6„ + T/a„) ^ e"^, 

and thus goes to upon letting T — > oo. Turning to the second term in f l3.17p we see that 
by Markov's inequality and independence of M^'s it is bounded by 

(3.18) ^!^(EM)^■^-*^ 

We need to see that this vanishes as n — )■ oo. Recall that EM < 1 and ji — > Xn where 
A > 0, so that (EM)-'!"*'' decays exponentially fast in n. Furthermore, 

dnK < Kmax{a'„, a'^} ■ max{6^, 6"} 

Recall that 6^ and b'^ satisfy fl3.15p (with different constants). Thus they both are O(lnn) 
as are Inpci/fe;^ and Inpc^/b'^. Hence, 

Since fu is an integrable function, we may assume that ^/Af(l — Ci/6^) = 0(1) as n — )• oo. 
Finally, recall that (6^) satisfies (13.151) . Therefore, 

= exp(-^) = > n-", a > 0, 

where the last inequality follows from the fact that 6^ — ?■ oo as n — t- oo which is evident 
from (I3.15p . It follows that na„6„ has a polynomial growth in n and thus that for every 
e > fl3.18p goes to as n — )■ oo. 

3.3. Extremal index. We establish the following fact about the extremal index of (-R„). 
It implies, in particular, that if M does not have an atom at 1, then the extremal behavior 
of {Rn) is exactly the same as it would be for independent -R„'s. 

Proposition 2. Let {Rn) he a stationary sequence satisfying the recurrence (12.60 . Then 
{Rn) has the extremal index 9 whose value is 

9 = limsupP(Mi? + g < Un\R > Un) = 1 - Po = 1 - P(Af = 1). 

n 
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Proof. Again following the authors of [4j we rely on Theorem 4.1 of Rootzen [18]. Since 
we have shown that D{un) holds for every sequence Un of the form hn + a;/a„, x > 0, it 
remains to verify condition (4.3) of that theorem i.e. to show that 

limSUp \ f{R\ne\ < Mnl-Ro > ^n) — 6*1 — 0, aS € \ 0. 

n— >oo 

To this end, for given e > 0, let m := := \nt\ . Then 

HR*m <Un\Ro> Un) = P(i?m < Un\R*m_i < Un, Rq > UnMR*m-l < Un\Ro > Un) ■ 

By Markov property, for m > 2 the first probability on the right-hand side is 

F{Rm < Un\Rm-l < Un) = P(M„i?„_i +q< Un\Rn,-l < Un) = f{MR + q< Un\R < Un). 

Continuing in the same fashion we find that 

W{Rl^ <Un\Ro> Un) = ¥"'~\MR + q<Un\R< U„)P(i?i < U„|i?,o > Un) 

= (1 - F{MR + q> Un\R < Mn))™"^ P(Mi? + q< Un\R > Un). 

So, clearly 

limsupP(i?.;^ <Un\Ro> Un) < limsupP(Mi? + g < > m„). 

n n 

On the other hand, 

WA#p^ ^ IP^ ^ nMR + q>Un,R<Un) ^ ¥{MR + q>Un) 
nP{MR + q > Un\R < Un) = n — — r < n- 



P(i? < Un) ~ 1 - P(i? > Ur. 

¥{R > Un) 

= n — — y p 

l-¥{R>Un) ' 

as n — )■ oo by the very choice of Thus 

limsupnP(Mi? + q > Un\R < Un) < e""" =: c < oo 



so that 
and hence 



liminf (1 - F{MR + q> Un\R < Wn))""^ > e" 

n 



limSUpP(/?;; < Mnl^O < Un) > C"" lim SUp P(Mi? + g <Un\R>Un). 

n n 

It follows that 

limlimsup {(1 - F{MR + q> Un\R < Mn))""^ F{MR + q< Un\R > 
= limsupP(Mi? + q< Un\R > Un). 

n—^oo 

We now turn to evaluating 

limsupP(Mi? + g < Un\R > Un). 
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It is clear that ii pq > then for every n such that Un> q have P(Mi? + q < Un\R > 
Un) = 1 — Po SO assume that Po = and write 

nMR + q< > = l-¥{MR + q> u^R = ^^^^ w^^^ ^ """^ • 

r[R > Un) 

It remains to show that the numerator in the last expression is of lower order than the 
denominator. To do that, let be a sequence converging to infinity but in such a way 
that tn = oipn)- Then 



/■oo 

P(Mi? + q> Un,R> Un) = / P(Mt + q> Un)dFR{t) 



fUn+tn poo \ 

+ / ]F{Mt + q>Un)dFR{t). 

J Un+tnJ 

Note that the probability underneath the integral is an increasing function of t. Bounding 
it trivially by 1 in the second term we see that this term is bounded by P(i? > m„ + 
This can be further bounded by 

f>{R>hn + -+ tn) = nR >bn + ^±^) < P(i? > 6„ + ^1^), 
dn dn 

whenever a^tn > T. It follows by the choice of and D{un) condition that 

¥{R >Un + tn) ^ _T 

¥{R >Un) - ' 

for arbitrarily large T and sufficiently large n and thus it vanishes as n — )■ oo. The first 
integral is bounded by 

P(M(U„ +tn)+q> Un)nUn < R < Un + tn) < P(M > 1 - ^^^±^)^{R > 

Un ~r t-n 

Since the first term goes to po = as n — )■ oo, we see that this term is o{¥{R > m„)) as 
n — )■ oo. This shows that the extremal index is 1 when po = and completes the proof. □ 



4. Remarks 



1. The main drawback of Theorem 1 is that it does not give a good handle on the norming 
constants (a„) and This is generally caused by a lack of precise information about 

the tails of the limiting random variable R. However, even in the rare cases in which more 
precise information about tails of R is available, the formulas seem to be too complicated 
to make the precise statements about (a„) and practical. For example, when q = I 
and M has Beta(a, 1) distribution, a > 0, (i.e. i? is a Vervaat perpetuity) then Vervaat 
[T9| Theorem 4.7.7] (based on earlier arguments of de Bruijn [3j) found the expression for 
the density of R. This, in principle, could be used to get precise enough asymptotics of 
the tail function of R and thus determine the asymptotic values of (6„) and (a„). However, 
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the nature of these formulas, makes obtaining exphcit asymptotic expressions for (a„) and 
{bn) difficult if not impossible. As far as we know, Vervaat perpetuities provide the only 
class of examples (within our restrictions on M and Q) for which the asymptotics of the 
tail function is known. On the other hand. Theorem [1] typically gives the order of the 
magnitude of (a^) and 

2. The expression fl3.16p for (a^) often simplifies to aj^ ~ — Colnpci/6^ (with corre- 
sponding simplification for (fln))- This will happen, for example, whenever po = and 
5/m(1 — S)/ps is bounded as 5 — )■ 0, in particular, when M is Beta(a, /3) random vari- 
able, a, (3 > 0. In that case, b'^ may be chosen to be asymptotic to ^^^'^^"^^ and then 
a'^ ~ Co/3 In Inn. Hence, (a„) and (6„) are of order In Inn and Inn/ In Inn, respectively. 
Note that Vervaat perpetuity corresponds to /3 = 1 and Dickman distribution to a = /3 = 1. 

3. There are, however, situations for which the above remark is not true. The following 
situation was considered in [121 Theorem 6]. Let M have density given by 

fM{t) = Kexp{- _ }, l<r<oo, < t < 1, 

where = i^^ is a normalizing constant. Then, as 5 \ 0, 

P5 ~ (1 - (1 - 5)^)^/(^-1) exp{-(l - (1 - 5)-)-V(-~i)} ^ (r5)-/(--i) exp{-{r6)-'^^'-^^}, 



so that 



On the other hand, 



/y \ /^/ X l/(r-l) / ^ y 

so that both terms appearing in f l3.16p are of the same order. Here again, the norming 
constants (a„), (6„) in Theorem [T]may be determined up to absolute multiplicative factors 
and are of order (Inn)^/'^ and (In n)^''-^)/'', respectively. 



4. Consider another example from [12] in which 

fM{t) = Kexp(^- ^dsy 0<t<l. 
Then (see [T2| Lemma 8]) Inp^ ~ —5e^^^ as 5 — > 0. Similarly, one can check that 

so this time the first term in the expression (I3.16P is of higher order than the second. It 
follows from the asymptotics above that a'^ ~ (In n) / cqCi and b'^ ~ ci In In n and hence 
(on), {bn) are of order Inn and In Inn, respectively. 
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